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In an earlier paper we identified three important questions 
that developers or evaluators of teacher training materials need 
to ask: 



2. Do teachers attain the skills that the materials were designed 
to teaoh? 

2, Do teachers use skills from the training materials in their 
classrooms? 

\ 3. Does the use of these skills by teachers have any effect on 
student Zeaxming? 

Since the focus of that paper was entirely on evaluation 
designs to aid in answering the third question listed above/ we 
shall take this opportunity to examine the first two questions. 
Our vehicle for discussing these questions in the context of a 
real-world situation is a self-instructional teacher training 
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module we developed and evaluated. It is titled Teaching for 
Mastery (TFM) and was designed to train preservice and inservice 
teachers to implement Bloom* s mastery learning strategy. 

The overall goal of the training program is to teach teachers 
to : implement a five-step plan for increasing the achievement of 
their students. The major skills required to do this are learn- 
ing to prepare and administer diagnostic tests over course ob- 
jectives at frequent intervals / and then to direct students to 
remedial work as needed. 

The package we eventually developed and tested consisted of 
a bound manual somewhat over 100 pages in length containing 
instruction, many pencil and paper exercises / and self tests 
for each of the six sections into which the program is divided.. 
A total of 22 outcomes are stated in the manual that range from 
sequencing objectives, to constructing diagnostic tests, to 
selecting alternative instruction for .unsuccessful students. 
The entire module required about 5 hours for a teacher to 
complete. 

Do Teachers Attain the Skills . . . . ? 

This primary concern of a developer or evaluator of teacher 
training materials can result in an endless delay in the develop- 
ment or evaluation effort if two prior questions have not been , 
asked and answered^ These, of course, arez What exaotly are the skills 
for whioh imining is to b^^ And What measureswill be used to determine 

whether the skills have been mastered? 



Using our TFM module development as an example, one of 
our first tasks was to clearly define the individual skills 
(performance objectives) that we felt teachers must acquire in 
order to reach the overall goal of the training program. Once ■ 
these objectives were identified, we proceeded to develop an ; 
evaluation measure for each of the 22 ob j ectives in the pro- 
gram. 

Once these preliminary tasks are completed^ the developer 
then has a more clearly defined picture of what instruction 
will need to be developed in order to get users to demonstrate 
attainment of the specified objectives. 

The next step in the process should be somewhat obvious. If , ^ 
as a developer of a certain instructional product, you have listed 
all the objectives you are trying to reach and you have the ways 
of knowing when you have reached them, the problem then becomes 
HOW you reach them. In other words, what kind and how much 
instruction must be provided to users of the product to get them 
to the point of being successful on the various measures of skill 
attainment? 

In developing self-instructional materials, such as our TFM 
module, care must be taken to present the instruction in a manner 
that minimizes the chance of losing. the learner as he or she is 
trying to work through the instructional package. Two important 
aspects of the instruction should be considered in this regard. 
First, the effects of different instructional sequences must be 
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considered. Unless the instructional objectives in the product 
are completely^ independent, the developer must attempt to sequence 
the instructional units in a manner that optimally facilitates 
learning among users who may use the materials in a non-tutorial 
setting. 

- A second consideration is the actual design or. format of the 
self-instructional materials. The question asked here is; What is ^ 

agoodpaiybeimtohave;!^^^ 

setting? In our TFM module, depending upon the difficulty of the ; \ 
objective, we used one of the two following patterns of instruction: 

(A) [instruction -^Practice ->> Feedback] -^|lnstruction^-> etc.^ 
>-(Obj. n) (Objo n + 1) 

(B) instruction Practice-^ Feedback ;->- More Practice.=^ 

^ (Obj. n) — — " — ■ 

E^Mor e Feedbackl-^flns true cion .--^ etc . J 
-' (Obj . n + 1) 

Following instruction and appropriate practice and feedback 
for three to five objectives^a test measuring learner's attain- 
ment of those objectives was presented. Again, due to the self- 
instructional mode of the module, the test was a self-test, and 
: feedback in the form of model answers had to be provided to the 
user for each self-test item. 

; One of the ways we judged the success of the instruction for ^ 
each objective was to examine the respective self-test item success 
: rates of users of the materials . We arbitrarily set as pur goal , ^ 
to have mastery of ekch objective in: the module demonstrated by 
■ at least; 80% iof the subjects (i.e. , preservice and inservice, , , 
teachers in our science methods classes) who tried the materials 
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during their various stages of developraent or revision. Needless 
to say, it required several cycles of material development — trial 
— revision to reach our goal* 

Do Teachers Use These Skills in Their Classrooms ? 

Even though the answer to the first of the three questions we 
posed at the beginning of this paper may be yes, little peace of 
mind is afforded to the instructional product developer .The 
second question proceeds to haunt him or her just as it would 
any teacher educator who is concerned with the outcomes of the 
training given to prospective or inservice teachers. 

There are several approaches one could take in finding an 
answer to this question, and each could result in differing degree 
of uncertainty associated with the findings. For example, if you 
used some teacher training materials with a group of preservice 
teachers you could merely ask them if they think they will use 
the skills they acquired when they actually teach a class o£ 
their own. If they all respond affirmatively, but you still 
feel the need for some additional proof , you cpuld ask them to 
contact you in a year or two when they have become classroom 
teachers and let you know if they are using the training they 
received. If, however^ you have neither the; patience nor the 
naivete required to follow the previous suggestion you will 

probably try another approach. 

A quicker way to obtain some, feedback about the classroom 
utilization of the training teachers receive is to ask inservice 
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teachers who are receiving the training to report on their 
attempts to practice their newly acquired skills in the class- 



room. 



And finally, if you are still plagued by insecurity as a 
result of your own uncertainty about the utility of a teacher 
training package, or by demands for some empirical support, you 
will need to conduct some type of classroom observation study of 
teachers who used the training package. ^.^^^^^^ : 

TO obtain some empirical evidence regarding whether or not 
teachers who used our TFM module could put into practice what our ■ 
training materials preached, we trained observers to record relevant 
events that occurred in elementary school classes taught by several 
randomly selected teachers who had studied our module as part of | 
a science methods course. Each teacher taught two class sections ; 
of students and was instructed to use the skills she had acquired 
through the TFM module in teaching one section and not to use 
these newly acquired skills in teaching the other section. 

The observers recorded the differences they observed between 
each teacher's pair of classes daily, using a form we designed for 
this purpose (Appendix A). When the two-week observation period 
ended and the data from the observation forms were gathered and 
analyzed, we found that the observers reported very sizeable 
differences in observable teacher behaviors when teachers taught 
their one section as compared to teaching the other. These 
differences were directly related to the training they were 
given in. the TFM module and which theyused in teaching , one 
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class but not the other. 

The results of our study had two important effects. First, 
it increased our own faith in the applicability of our. training 
materials in actual classroom teaching situations. Second, it 
satisfied a necessary prerequisite to conducting studies of the 
effects of the .training teachers received on their students. In 
other words, it. would be a wasted effort to conduct a study of 
the effects on students of different teaching strategies, unless 
one could first show proof that different teaching strategies 
were, in fact, being exhibited by the teachers in the study. ^ . ; 

It is our belief that the question addressed in this second 
half of this paper needs to receive much more attention than it 
has in the past i» Questions about what methods to use in develop-, 
ing training materials for teachers or in measuring the effects 
of the training on students seem to have overshadowed the equally 
important problem of finding methods to use in studying the degree 
to which the training teachers receive is put into practice in the 
classroom. 



*For a more complete description of this procedure and 
analysis see Ciesla, J. L., & Okey, J. R. , The effects of train- 
ing preservice teachers to use Bloom' s mastery teaching strategy: 
A process-product study. Paper presented at the AERA Annual Meeting 
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BEST COPY AVAILABLE APPENDIX A • 

Observer: 

Date: 

. '■ Teacher: 



023ERVj;H'S DIRUCnOKSs 

' Complete one of these observation forms each day during the last five minutes 
of Period th-^^n give the f onn. to Mr, Ciesla. 

On the left side of this form are descriptions of events you may have observed 
during the teacher's first teaching period, (Period A), or during her second 
teaching period, (Period D). For each description you are to circle one of the 
six designation's on the right side of the form to, indicate what you observed, 

y ■ Circle A-— — ^-If the description applies only to Period A » 

Circle Ab-*^ — — If the description applies mainly to Pe r iod A 
and to a lesser extent, to Period e" 

■ Circle ab- — If^the description applies equally to Per iods A k B.: 

•.• Circle aB-r If the description* applies mainly to Period's 

. 0 ' . and to a lesser extent to Period A. 

. Circle B --^ — -If the description applies only to Peri od B . 
• ^ N r-If the description applies to neither Period A nor Period B.-Xi.. ' 

,1# After pupils completed instruction ; cove ring one or ; ■ ^ • - • • !• A Ab ab aB B^^^ N 
' /• . ; more objectives, they were tested, for mastery of . . ' /. ' . . v / - . . 

these objectives.. . ' .'^ 

r'-.r:^.2. Pupils. corrected their a>rn tests, 2. A Ab ab aB B . N 

3. Pupils ' performances on tests were judged accept- 3. A Ab ab ' aB B ' -i N 

able when they acMeved the level of competency 
. ,..sre. rifled in the norform^ince- objectives, - 

r )j, ''/he:n pupils failo 1 to demorstr^te mnsterj'^ of an . U, A Ab ab a3 B 

■ . . obj3ctlve : t to repeat the same 

irritructior they ]iad received, 

;.ii5« vJh^n ipupils failef! to demonstrate m?istery of; qn: 5» A Ab ab aB B^ K; 

: ■ . objective th.-^y were given some alternnte form 

.of instruction^-- , ■ ■ . 

6, The teacher used a variety of ins time tional 6, A Ab ab aB B 

. methods in teaching, 

■ 7, The teacher kept record of each pupil 's 7, A Ab ab aB B . M 

; ; daily progress,, 



The teacher conducted - lessor aimed at one or 
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